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Sutiimary; 

iieans  and  standard  deviations  of  test  scores  are  reported  for  a 
population  of  coimiiissioned  candidates  for  submarine  school.  Correla¬ 
tion  coefficients  shovdng  the  relationship  of  the  scores  to  each  other 
and  to  submarine  school  grades  are  presented.  It  is  noted  that  of  the 
various  sections  of  these  tests,  those  on  arithmetic  reasoning  and 
mechanical  comprehension  yield  the  largest  coefficients. 

At  the  present  tirae  the  officers*  course  in  the  submarine  school 
involves  12  weeks  of  study  in  the  principles  and  operation  of  subma¬ 
rines,  All  candidates  for  the  school  are  volunteers,  and  are  assigned 
to  New  London  only  after  approval  of  their  qualifications.  Indeed, 
those  who  are  assigned  from  Midshipmen  schools  iiave  been  carefully 
screened  by  a  board  of  submarine  officers  prior  to  assignment.  Thus 
the  population  on  which  this  report  is  baaed  is  a  soinewhat  selected 
sa-aple  of  junior  convaissioned  officers. 

The  study  was  undertaken  in  order  to  determine  the  interrelation¬ 
ship  of  certain  selection  devices  and  the  success  of  those  devices  in 
predicting  grades  in  subxru.rine  school.  The  choice  of  tests  v/as  govern¬ 
ed  by  previous  decisions  on  the  proposed  content  of  the  Officer  Classi¬ 
fication  Testj  both  scales  discussed  in  this  paper  are  incorporated  in 
modified  form  in  this  new  instrument, 

OSiiD  Report  No.  3168  indicates  that  one  of  the  three  sections  of 
the  Officer  (;ualification  Test  bears  a  low  relationship  to  grades  in 
indoctrination  school.  The  weak  section  v/as  that  dealing  'ixith  mechanical 
comprehension.  Preliminary  research  at  this  activity,  however,  made  it 
appear  that  the  least  valid  of  the  three  in  terms  of  submarine  school 
grades  was  the  vocabulary  section.  This  study  vxill  furnish  further  data 
on  the  question. 

Procedure; 

Both  tests  vrere  applied  as  a  part  of  the  adi-iission  procedure  for 
candidates  for  submarine  school,  Cti  the  printed  schedule  for  each 
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officer,  one  event  was  listed  as  "Aptitude  Tests."  Thus,  although  the 
tests  were  actually  experimental,  the  candidates  regarded  theia  as  one 
of  the  several  hurdles  which  were  to  be  satisfied  along  v;ith  the  medi¬ 
cal  examinations,  training  in  the  use  of  the  escape  appliance,  svdmming 
tests,  etc.  Since  each  officer  was  a  volunteer  for  submarine  duty, 
conditions  were  ideal  from  the  standpoint  of  test  motivation.  Physical 
conditions  for  conducting  examinations  vjere  also  satisfactory.  Altogeth¬ 
er,  four  groups  comprising  a  total  of  284  officers  v/ere  examined. 

The  order  of  administration  was  not  varied.  The  Officer  Qualifi¬ 
cation  Test  'was  first  on  the  schedule,  then  a  ten-niLnute  rest  vras  inter¬ 
polated  before  administration  of  the  mechanical  Aptitude  Test.  There 
were  no  pauses  betoeen  sections  of  the  latter  beyond  the  tirae  necessary 
for  the  examiner  to  read  the  instructions  aloud. 

Only  tliree  sections  of  the  mechanical  Aptitude  Test  were  used; 
Section  A,  dealing  with  assembly  of  plane  surface  figures,  was  omitted 
in  accordance  with  suggestions  from  tiie  Test  ..ie search  Unit  of  the 
Bureau  of  Personnel,  The  time  liioits  for  the  different  sections  are 
as  follov/s: 

Block  Assembly  15  minutes 

dotation  of  Solid  Figures  20  minutes 

kechanical  Comprehension  25  minutes 

Some  of  the  candidates  failed  to  qualify  for  submarine  school,  and 
others  later  failed  the  school  because  of  loxv  aptitude  ratings,  Neither 
of  these  two  groups  is  treated  in  this  study,  however.  In  the  first 
place,  the  failures  are  priiiiarily  a  matter  of  evaluations  of  personal 
aptitude  rather  than  of  academic  grades.  And  second,  test  scores  were 
known  to  medical  officers  who  figure  to  some  extent  in  disqualifications. 
Accordingly,  it  vras  decided  to  deal  only  vdth  grades  for  officers  who 
cSompleted  the  course, 

Hesults; 

Each  test  vrais  scored  b-  counting  the  nuraber  of  questions  ansivered 
correctly.  The  correlation  betv/een  total  score  for  the  three  sections 
of  the  CklAT  and  total  rav/  score  for  the  OQT  is  based  on  the  entire 
number  tested,  or  2S4.  The  product  moa'-ent  coefficient  is  0,46,  Means 
and  standard  deviations  for  total  scores  and  part  scores  for. each  test 
are  indicated  in  Table  I,  belov/. 
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TABLE  I 


Means  and  Standard  Deviations 


284  Candidates 

258  Graduates 

MEAN 

S.D. 

MEAN 

3*Dn 

OQT  Total 

65.37 

13.77 

66.33 

13.72 

H 

Vocabulary 

27*30 

8.40 

27.34 

B.Ll 

It 

Mech,  Comprehension 

21.75 

4.19 

22.00 

4.16 

It 

Arith,  xieasoning 

14*39 

3.12 

15.12 

3.08 

QaAT  Total 

73.95 

14.26 

74c  30 

14.21 

It 

Block  Counting 

21.75 

4.30 

21.80 

4o28 

tt 

Block  Rotation 

20.04 

5.36 

20.13 

5.33 

tl 

Mech,  Comprehension  33*14 

7.92 

33.40 

7.82 

Final  grades  in  ths  submarine  school  are  a  weighted  ccfAbination 
of  several  marks.  Each  examiiiation  grade  is  multiplied  by  a  given 
coefficient;  and  the  final  grade  is  a  fraction  of  the  sum  of  the  pro¬ 
ducts,  The  coefficients  in  effect  at  this  time  are  shorn  in  Table  II, 

It  should  be  emphasized  that  the  coefficients  do  not  of  theiAselves  de¬ 
termine  the  weight  of  a  given  examination,  because  the  variabilities 
for  the  exaridnation  grades  differ.  For  exan\ple,  the  mean  of  the  ranges 
for  the  three  aptitude  grades  is  approximately  one-half  the  mean  of  the 
ranges  for  all  other  grades.  The  distributions  and  the  intercorrelations 
of  the  grades  are  not  discussed  in  this  report,  nor  are  correlations  of 
tests  with  individual  subjects  treated.  For  the  purposes  of  this  study, 
the  final  multiple  grade  is  assumed  as  the  criterion, 

TABLE  n 


Coefficients  for  Officers'  Course 


Submarine  Examination,  First  20 
Electrical  Examination,  First  20 
Engineering  Examination,  First  20 
Torpedo  Examination,  First  20 
Communication  Examination,  First  20 
Aptitude,  4th  keek  10 
General  Examination,  average  15 
Aptitude,  8th  Week  20 
Attack  Teacher,  8th  Week  20 
Submarine  Training  Device,  8th  v;eek  15 


-  continued  next  page  - 
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Underway  Approach  20 
Torpedo  Preparation  and  Reports  5 
Attack  Teacher,  12th  .feek  15 
Aptitude,  12th  Week  20 
Submarine  Training  Device,  12th  Week  10 
Communication  Examination,  12th  i/eek  15 
Submarine  Examination,  12th  i/eek  15 
Electrical  Examination,  12th  V/eek  15 
Engineering  Examination,  12th  w'eek  15 
Torpedo  Exaraination,  12th  Week  15 


Total  Co-efficient  325 

Correlation  coefficients  with  the  final  multiple  grades  are  in¬ 
dicated  in  Table  III  belov/.  Some  data  are  also  presented  for  238 
graduates  of  the  previous  class, 

TABLE  III 

Product-moment  correlation  coefficients  of 
scores  with  Suhri’iarine  School  grades. 


Test  Score _ Jan-April  Class  April-June  Class 


OQT  Total 

0.38 

0.46 

"  Vocabulary 

0.23 

0,24 

'<  lioch,  Coi'.iprehcnsion 

0.35 

0.35 

"  Arith.  Reasoning 

0.38 

0.47 

”  Arith.  Reasoning 
plus  imech.  Comprehension 

0.40 

0.47 

OaAT  Total 

0,36 

”  Block  Counting 

0.28 

'•  Block  Rotation 

0.25 

”  Mech,  Comprehension 

0.34 

Discussion: 

Inspection  of  Table  III  shows  tliat  those  sections  involving  arith¬ 
metic  reasoning  and  mechanical  comprehension  eire  the  most  closely  re¬ 
lated  to  grades  in  submarine  school.  Indeed,  the  score  on  the  arithme¬ 
tic  reasoning  section  alone  appears  to  be  as  good  an  indicator  of  sub¬ 
sequent  grades  as  the  total  0^  score,  and  the  mechanical  comprehension 
score  of  the  CMAT  is  almost  as  efficient  as  the  total  CMAT  score. 
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It  is  noted  that  a  combination  of  the  total  scores  for  the  (MAT 
and  OQl  tests  does  not  increase  the  accuracy  of  the  forecasting  that 
can  be  Liade  from  the  OQT  alone.  Of  the  combinations  investigated,  the 
sum.  of  scores  for  the  arithmetic  reasoning  and  mechanical  comprehen¬ 
sion  sections  appears  to  be  the  most  promising.  However,  no  methods 
of  combinations  other  than  simple  addi-tions  of  raw  scores  have  been 
explored.  It  has  been  suggested  by  various  intervi  e^ving  officers  tliat 
some  profile  or  grid  scoring  technique  might  yield  better  prediction 
than  total  scores.  It  is  probable  that  such  techniques  involve  low  re¬ 
liabilities,  but  at  any  rate  these  suggestions  might  be  pursued  in 
studies  of  the  Officer  Classification  Test, 

Analysis  of  the  grades  at  the  Submarine  School  is  indicated  before 
any  elaborate  studies  of  test  validation  may  be  executed.  Arrangements 
for  such  research  are  undenvay,  and  should  permit  a  detailed  study  of 
the  Officer  Classification  Test  in  the  near  future.  However,  even 
vdthout  statistical  analysis,  one  general  characteristic  of  the  final 
grade  may  be  perceived  by  reference  to  Table  II,  This  table  points  to 
a  predominance  of  technical  engineering  material  in  the  course. 

Finally,  it  should  be  emphasized  that  no  data  were  imrAediately 
available  from  previous  administrations  of  officer  selection  instru¬ 
ments,  A  few  individuals  involved  in  this  study  volunteered  the  infor¬ 
mation  that  they  had  been  examined  twice  with  other  forms  of  the  Offi¬ 
cer  Qualification  Test,  There  are  no  means  of  evaluating  the  influence 
of  antecedent  tests  on  the  scores  reported  herein.  At  any  rate,  there 
would  have  been  a  saving  in  testing  time  and  possibly  some  chajige  in 
score  distributions  and  validity  coefficients  if  records  for  previous 
examinations  had  been  maintained  in  such  form  that  they  were  accessible. 
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